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(57) Abstract 



A parallel concatenated con volut tonal coding scheme utilizes tail-biting nonrccursive systematic convolution! codes. The associated 
decoder iterativety utilizes circular maximum a. posteriori decoding to produce hard and soft decision outputs. This encoding/decoding 
system results in improved error- conection performance for short messages. 
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PARALLEL CONCATENATED TAIL-BITTNO 
CONVOLUTIONAL CODE AND DECODER THEREFOR 



Field of the Invention 

The present invention relates generally to error-correction coding 
5 for the communication of short messages over poor channels and. more 
particularly, to a parallel concatenated convolutional coding technique and a 
decoder therefor. 

Background of the Invention 

One form of parallel concatenated coding, referred to as either 
10 parallel concatenated convolutional coding (PCCC) or "turbo coding", has been 
the subject of recent coding research due to impressive demonstrated coding 
gains when applied to blocks of 10,000 or more bits. (Sec C. Berrou, A. 
Glavicux and P. Thitimajshima, "Near Shannon Limit Error-Correcting Coding 
and Decoding: Turbo-Codes;' Proceedings of the IEEE International 
15 Conference on Communications, 1993, pp. 1064-1070; J.D. Andersen, "The 
TURBO Coding Scheme," Report IT- 146 ISSN 0105-854, Institute of 
Telecommunication, Technical University of Denmark, December 1 994; and P. 
Robertson, ''Illuminating the Structure of Code and Decoder of Parallel 
Concatenated Recursive Systematic (Turbo) Codes," 1994 IEEE Globecom 
20 Conference, pp. 1298-1303.) 

However, it has been shown that the performance of a turbo 
code degrades substantially as the length of the encoded data block decreases. 
This effect is due to the strong dependence of its component recursive 
systematic convolutional codes' weight structures on block length. A second 

25 issue is the proper termination of message blocks applied to a turbo encoder. 

As described by O. Joersson and H. Meyr in 'Terminating the Trellis of Turbo- 
Codes," IEE Electronics Utters, vol. 30. no. 16. August 4. I 994, pp. 1285- 
1286, the interleaving used in turbo encoders may make it impossible to 
terminate both the interleaved and non- interleaved encoder input sequences with 

30 asingle set of tail bits. While it is possible to use a second tail sequence 
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embedded into the message structure such thai the encoder operating on the 
interleaved data sequence is properly terminated, this doubles the overhead 
associated with encoder termination and reduces the effective code rate. An 
alternative is not to terminate one of the encoder sequences, but this degrades 
5 performance of the encoder/decoder system, particularly when applied to short 
messages. In Terminating the Trellis of Turbo-Codes in the Same State,** IEE 
Electronics Letters, 1995. vol. 31, no, U January 5 t pp. 22-23, A. S. Barbulescu 
and S.S. Pietrobon reported a method that places restrictions oa the interleaver 
design in order to terminate two component recursive systematic convolution^ 
10 (RSC) encoders with a single termination bit sequence. Their performance 
results show some degradation compared to performance obtained by 
terminating both encoders when an optimized interleaver is used. In addition, 
published bit-error rate (BER) versus c n ergv-per- bi t- to- n oise - po wer- spectral - 
density ratio (Efc/N^) data exhibit a flattening in BER over a range of E t /N Q 

15 values when RSCs are utilized in the turbo encoder. 

.Accordingly, it is desirable to provide an improved parallel 
concatenated coding technique for short data blocks. 

Summary of the Invention 

In accordance with the present invention, a parallel concatenated 
2 0 convolurional coding scheme utilizes tail-biting nonrecursive systematic 

convolutional (NSC) codes. The associated decoder iterarively utilizes circular 
maximum a posteriori (MAP) decoding to produce hard and soft decision 
outputs. Use of tail-biting codes solves the problem of termination of the input 
data sequences in turbo coding, thereby avoiding associated decoder 

2 5 performance degradation for short messages. While NSC codes are generally 

weaker than recursive systematic convolunonal (RSC) codes having the same 
memory asymptotically as the data block length increases, the free distance of a 
NSC code is less sensitive to data block length. Hence, parallel concatenated 
coding with NSC codes will perform better than with RSC codes having the 

3 0 same memory for messages that arc shorter than some threshcld data block 

size. 
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Brief rv^griorion of th e Drawing s 

The features and advantages of the present invention will 
become apparent from the following detailed description of the invention when 
read with the accompanying drawings in which: 

FIG. 1 is a simplified block diagram illustrating a parallel 
concatenated encoder, 

FIG. 2 is a simplified block diagram illustrating a decoder for 
parallel concatenated codes; 

FIG. 3 is a simplified block diagram illustrating a tail-biting, 
nonrecursivc systematic convolution^ encoder for use in the coding scheme 
according to the present invention; 

FIG. 4 is a simplified block diagram illustrating a circular MAP 
decoder useful as a component decoder in a decoder for a parallel concatenated 
convolution coding scheme according to the present invention; and 

FIG. 5 is a simplified block diagram illustrating an alternative 
embodiment of a circular MAP decoder useful as a component decoder for a 
parallel concatenated convolurional coding scheme according to the present 
invention 

Detailed Descriprinp of the Inventing 

FIG. 1 is a general block diagram of encoder signal processing 
10 for parallel concatenated coding schemes. It comprises a plurality N of 
component encoders 12 which operate on blocks of data bits from a source. 
The data blocks are permuted by interleaving algorithms via interleavers 14. As 
shown, there are N- 1 interleavers for N encoders 12. Finally, the component 
encoder outputs are combined into a single composite codeword by a 
composite codeword formatter 1 6. The composite codeword formatter is \ 
chosen to suit the characteristics of the channel, and it may be followed by a J/ 
frame formatter chosen to suit the channel and communication system's \ 
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channel access technique. The frame formatter may also insert other necessary 
overhead such as control bits and synchronization symbols. 

A significant code rate advantage can be obtained in parallel 
concatenated coding if the component codes are systematic codes. The 
5 codewords (output) generated by a systematic encoder include the original data 
bits provided as inputs to the encoder and additional parity bits. (The 
redundancy introduced by the parity bits is what yields a code's error correction 
capability.) Therefore, when systematic encoders are used in the parallel 
concatenated encoder shown in FIG. 1, the codewords produced by all 
1 0 component encoders 12 contain the input data bits. If formatter 16 forms a data 
packet or c omposite codeword comprising only the parity bits generated by 
each component encoder!^ and the block of information bits to be coded, a 
substantial improvement in the rate of the composite parallel concatenated code | ^ 
is realized by eliminating repetition of the information bits in the transmitted 
composite codeword. For example, if component encoder 1 and component 
encoder 2 of a parallel concatenated convolution^ code (PCCC) encoder 
comprising two component codes are both rate 1/2 codes, the composite 
parallel concatenated code rate is increased from 1/4 for nonsystematic 
component codes to 1/3 when systematic component codes are used. 



15 



20 



25 



30 



Parallel concatenated coding schemes which utilize recursive 
systematic convolution^ (RSQ codes have been the recent topic of much 
research. These parallel concatenated convolutional codes (PCCCs) are also 
commonly known in the literature as "turbo" codes. As noted hereinabove, it 
has been demonstrated that these PCCCs can achieve impressive performance 
in terms of bit error rate (BER) versus the energy per bit to noise power 
spectral density ratio (Eq/Nq) for the case of relatively large messages, i.e.. ten 

thousand or more bits. However, it has also been shown that the coding gain 
obtained with turbo codes degrades significandy with decreasing data block size 
because the recursive systematic convolutional component codes' strengths arc 
quite sensitive to data block length. On the other hand, the performance of a 
nonrecursive systematic tail-biting convolutional code is independent of data 
block length for most practical purposes; the obtainable performance degrades 



i 
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only if the block of data bits encoded is less than a minimum size that is 
determined by the NSCs decision depth properties. 

FIG. 2 illustrates a general decoder 20 for parallel concatenated 
codes in block diagram form. Decoder 20 comprises the following: a 
5 composite-code word- to-component- codeword converter 22 which converts the 
composite codeword received from a channel to individual received codewords 
for each component decoder 24; N component decoders 24 corresponding to 
the N component encoders of FIG. 1 ; the same type (or same) interleaves 14 
that are used in the parallel concatenated encoder (FIG. 1); and first and second 
10 deinterleavers 28 and 29, respectively, that each have a sequence reordering 

characteristic that is equivalent to a series concatenation of N- J deinterleavers 30 
corresponding to the N-l interleavers used for encoding. The required ordering 
of these deinterleavers is shown in FIG. 2 and is the reverse of the ordering of 
the interleavers. The outputs of component decoders 24 are some type of soft- 
15 decision information on the estimated value of each data bit in the received 

codeword. For example, the outputs of the component decoders may be a first 
function of the probabilities that the decoded bits are 0 or 1 conditioned on the 
received sequence of symbols from the channel. One example of such a first 
function removes the influence of the conditional probability Pfd f = O I Y f J 
20 from a component decoder's soft-decision output that is inputted to a next 

sequential component decoder after an appropriate permutation, where P(dj = 

O I Yf ) is the probability that the j 1 ^ information bit at time t is 0 conditioned 

on the (systematic) bit of the received channel output symbol Y t . 
Alternatively, the soft-decision information outputted by component decoders 
2 5 24 may be a function of the likelihood ratio 



A(d J t ) = 



pfci; = 1 1 Yj L j 

P{dj = 0 I Yj L J 



j • P{df = o i r/v 
Pfdf = o I r/v 



or as a function of the log-likelikelihood ratio log [ A ( iV 



)} ■ 
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As shown, the N 1 * 1 component decoder has a second output, i.e., a second 
function of the conditional probabilities for the decoded bit values or likelihood 
ratios above. An example of this second function is the product of Pfdj = 0 1 
Yj-J and then priori probability that d\ = 0 received from the previous 
5 component decoder. 

The decoder for parallel concatenated codes operates iteratively 
in the following way. The first component decoder (decoder 1) calculates a set 
of soft-decision values for the sequence of information bits encoded by the first 
component encoder based on the received codeword and any a priori 

10 information about the transmitted information bits. In the first iteration, if there 
is no a priori information on the source statistics, it is assumed that the bits are 
equally likely to be C) or l(i.e.. Pfbit = 0} = Pfbit = !J=l/2 ). The soft- 
decision values calculated by decoder 1 are then interleaved using the same type 
(or same) interleave! that was used in the encoder to permute the block of data 

15 bits for the second encoder. These permuted soft-decision values and the 

corresponding received codeword comprise the inputs to the next component 
decoder (decoder 2). The permuted soft-decision values received from the 
preceding component decoder and interleaver are utilized hy the next 
component decoder as a priori information about the data bits to be decoded. 

20 The component decoders operate sequentially in this manner until the N T 

decoder has calculated a set of soft-decision outputs for the block of data bits 
that was encoded by the encoder. The next step is deinterleaving soft-decision 
values from the N A decoder as described hereinabove. The first decoder then 
operates on (he received codeword again using the new soft-decision values 

25 from the decoder as its a priori information. Decoder operation proceeds 
in this manner for the desired number of iterations. At the conclusion of the 
final iteration, the sequence of values which are a second function of the soft- 
decision outputs calculated by the decoder is deinterleaved in order to return 
the data to the order in which it was received by the PCCC encoder. The 

30 number of iterations can be a predetermined number, or it can be determined 
dynamically by detecting decoder convergence. 
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The decoder provides soft-decision information which is a 
function of the probability Pfd J f = 0 I Y L } ; that is, the conditional probability 

that the j 111 data bit in a k-bit symbol input to the encoder at time / is 0 given that 

the set of channel outputs Y^ = fy y,...,y L J is received. In addition, the 

5 decoder may provide hard-decision information as a function of its soft- 
decision output through a decision device which implements a decision rule, 
such as: 

i 

That i^\(P(d i j = 0\Y L J } > j, thenS^ = 0; if PfJ = O I Y^J < then 2^ 
10 =7; otherwise, randomly assign d/ the value 0 or 1. 

Typical turbo decoders utilize either maximum a posteriori 
(MAP) decoders, such as described by L.R. Bahl, J. Cocke, F. Jelinek and J. 
Raviv in "Optimal Decoding of Linear Codes for Minimizing Symbol error 
Rate," IEEE Transactions of Information Theory, March 1974, pp. 284-287, or 
15 soft output Viterbi algorithm (SOVA) decoders, as described by J. Hagenauer 
and P. Hoeher in "A Viterbi Algorithm with Soft-Decision Outputs and its 
Applications, 1989 IEEE Globecom Conference, pp. 1680- 1686. A MAP 
decoder produces the probability that a decoded bit value is 0 or i . On the odier 
hand, a SOVA decoder typically calculates the likelihood ratio 



20 



P{ decoded bit is 1 } 
Pf decoded bit is 0 J 



for each decoded bit. It is apparent that this likelihood ratio can be obtained 
from Pf decoded bit is 0J and vice versa using Pf decoded bit is 0} = J - 
Pf decoded bit is J J. Sorrie computational advantage has been found when 
either MAP of SOVA decoders work with the logarithm of likelihood ratios, 
25 that is, 



f Pf decoded bit is 1 } \ 
l ° s [ Pf decoded bit is 0 f )' 
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It has been demonstrated that the coding gain (error correction 
capability) obtained with turbo codes degrades significantly with decreasing 
data block size. Several authors have attributed this behavior primarily to the 
properties of RSC codes. It has been shown that the distance property of a 
5 RSC code increases with increasing data block length. Conversely, the 

minimum distance of a RSC code decreases with decreasing data block length. 
A second problem is the difficulty in terminating all RSC codes comprising a 
turbo coding scheme due to interleaving. Disadvantageous^, the adverse 
effects resulting from a lack of sequence termination or the imposition of 
1 0 restrictions on interleaver design are significant and become even more so with 
decreasing data block length. 

In accordance with the present invention, the component codes 
in a paxaHel concatenated convolutional coding scheme comprise tail-biting 
nonrecursive systematic convolutional codes. The use of such tail-biting codes 

1 5 solves the problem of termination of the input data sequences in turbo coding, 
thereby avoiding decoder performance degradation for short messages. 
Although NSC codes are generally weaker than RSC codes having the same 
memory, the free distance of a NSC code is less sensitive to data block length. 
Hence, parallel concatenated coding with NSC codes will p e ifuun better than 

20 with RSC codes having the same memory for messages that are shorter than a 
predetermined threshold data block size. The performance cross-over point is a 
function of desired decoded bit error rate, code rate, and code memory. 

FIG. 3 illustrates an example of rate » 1/2, memory =» m tail- 
biting nonrecursive systematic convolurional encoder for use in the parallel 

25 concatenated convolutional coding (PCCC) scheme of the present invention. 

For purposes of description, an (n. k, m) encoder denotes and encoder wherein 
the input symbols comprise k bits, the output symbols comprise n bits, and m 
= encoder memory in it-bit symbols. For purposes of illustration, FIG. 3 is 
drawn for binary input symbols, Le., k = /. However, the present invention is 

30 applicable to any values of n .and m. 

Initially, a switch 50 is in the down position, and L input bits are 
shifted into a shift register 52, k at a rime (one input symbol at a time for this 
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example). After loading the bit into the encoder, the switch moves to the up 
position and encoding begins with the shift of the First bit from a second shift 
register 54 into the noniecursive systematic encoder, the state of the encoder at 

this time is {b L , bL ] *JWim-; j/- to this example, the encoder output 

5 comprises the current input bit and a parity bit formed in block 56 (shown as 
modulo 2 addition for this example) as a function of the encoder state and the 
current input symbol. Encoding ends when the Uh bit is encoded. 

Another aspect of the present invention, the associated decoder 
for the hereinabove described parallel concatenated encoder, comprises a 

1 0 circular MAP decoder as described by the present inventors in commonly 
assigned, copending U.S. Patent Application No. (RD-24,923), which is 
incorporated by reference herein. In particular. U.S. Patent Application No. 
(RD-24,923) describes a circular MAP decoder useful for decoding tail -biting 
convolutional codes. The circular MAP decoder can deliver both an estimate of 

1 5 the encoded data block and reliability information to a data sink, e.g„ a speech 
synthesis signal processor for use in transmission error concealment or 
protocol processor for packet data as a measure of block error probability for 
use in repeat request decisions. 

In particular, as described in U.S. Patent Application No, (RD- 
2 0 24.923), a circular MAP decoder for error-correcting trellis codes that employ 
tail biting produces soft-decision outputs. The circular MAP decoder provides 
an estimate of the probabilities of the states in the first stage of the trellis, which 
probabilities replace the a priori knowledge of the starting state in a conventional 
MAP decoder. The circular MAP decoder provides the initial stale probability 

2 5 distribution in either of two ways. The first involves a solution to an eigenvalue 

problem for which the resulting eigenvector is the desired initial state 
probability distribution; with knowledge of the starring state, the circular MAP 
decoder performs the rest of the decoding according to the conventional MAP 
decoding algorithm. The second is based on a recursion for which the iterations 

3 O converge to a starring state distribution. After sufficient iterations, a state on the 

circular sequence of states is known with high probability, and the circular 
MAP decoder performs the rest of the decoding according to the conventional 
MAP decoding algorithm. 
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The objective of the conventional MAP decoding algorithm is to 
Find the conditional probabilities: 

Pf state m at time t I receive, channel output* yj yj 

The term L in this expression represents the length of the data block in units of 
the number of encoder symbols. (The encoder for an (n, k) code operates on k- 
bh input symbols to generate «-bit output symbols.) The term y, is the channel 

output (symbol) at time /. 

The MAP decoding algorithm actually first finds the probabilities: 

A/m) = P(S, = m; Yj ) ; 

that is. the joint probability that the encoder state at time t, S, , is m and the set 

of channel outputs Y^ = ly } y L J is received. These are the desired 

probabilities multiplied by a constant (P/t/;. the probability of receiving the 

set of channel outputs fyj yjj) ■ 

Now define the elements of a matrix F, by 
r/ij) = Pf state jot time t; y, I state i at time t-1 .} 

The matrix I") is calculated as a function of the channel transition pn.bahility 
R(Y U X), the probability /nfmlm'J that the encoder makes a transition from state 
m' to m at time t, and the probability q{X\m\m) that the encoder's output 
symbol is X given that the previous encoder state is m and the present encoder 
state ism. In particular, each element of T x is calculated by summing over all 
possible encoder outputs X as follows: 

(2) 

y t (m',m) = ^J>t(m\m) c/ t (X\m'.m) R(Y,. X) 
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The MAP decoder calculates L of these matrices, one fo^each trellis stage. 
They are formed from the received channel output symbols and the nature of 
the trellis branches for a given code. 

Next define the M joint probability elements of a row vector a. f 

by 

ctfj) = Pf state j at time t;y Jt „. t y t l (3) 

and the M conditional probability elements of a column vector fi t hy 

P t (j) = Pfy t +l—yL 1 state j at time tf (4) 

for j-OJ (M~J) where M is the number of encoder states. (Note that 

matrices and vectors are denoted herein by using boldface type.) 

The steps of the MAP decoding algorithm are as follows: 

(i) Calculate a Jf a L by the forward recursion: 

tx t = a t ^r t , t=l t „.,L . (5) 

(ii) Calculate fi Jf fi L ,j by the backward recursion: 

P, = r t+ iP,+i- < = L1 ^ 



20 (iii) Calculate the elements of A t by: 

A/i ) = a s (i) p/i) . all i. r= 7.....L . (7) 

(iv) Find related quantities as needed. For example, let/4^ be the set of states 
S t = fS 2 f S 2 ft .... Spjj such that the 1 th element of S t . S J { . is equal to zero. For 
25 a conventional non-recuisive trellis code. S* = d J ^ the 1 th data bit at time r. 
Therefore, the decoder's soft-decision output is 



15 
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where P(Y^J = £ and 
m 

m is the index that corresponds to a state S t . 

The decoder's hard-decision or decoded bit output is obtained by 
applying P(d i [ = Oiy^'to the following decision rule: 



Pfd i t = 0\Y L J / < f. 

f 

That is. if PfJ, = " I Y L jJ > ^. then 2', = 0; if />/< - 0 I ^ < J then cl\ = 
7 ; otherwise, randomly assign j f ihe value 0 or 1 . 

As another example of a related quantity for step (iv) hereinabove, the matrix of 
10 probabilities a t comprises elements defined as follows: 

oi(U;=P{S t -i=i;S t = .i; Y L 1 } = a hJ (i) y, (u j) /3, (i) 

These probabilities are useful when it is desired to determine die a posteriori 
probability of the encoder output bits. 

In the standard application of the MAP decoding algorithm, the 
15 forward recursion is initialized by the vector a () = (1.0.....0), and the backward 
recursion is initialized by ft = (J.0....O)T . These initial conditions are based on 
assumptions that the encoder s initial state S 0 = 0 and its ending state S L - O. 

One embodiment of the circular MAP decoder determines the 
initial state probability distribution by solving an eigenvalue problem as 
20 follows/Let CC t .fJ p r t *nd A, be as before, but take the initial a () and p L as 

follows: 

SUBSTITUTE SHEET (RULE 26) 
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Set fi L to the column vector (11 l...l) T . 
Let be an unknown (vector) variable. 

5 Then, 

(i) Calculate T x for t = J, 2, ... L according to equation (2). 

(it) Find the largest eigenvalue of the matrix product F 2 ... J^. Normalize 
the corresponding eigenvector so that its components sum to unity. This vector 
is the solution for tt { y The eigenvalue is Y ' j* J . 

10 (iii) Form the succeeding a t by the forward recursion set forth in equation (5). 

(iv) Starting from fi L , initialized as above, form the /J, by the backward 
recursion set forth in equation (6). 

(v) Form the X { as in (7), as well as other desired variables, such as, for 
example, the soft-decision output P{d* t = 0lY L jJ or the matrix of probabilities 

15 cr f , described hereinabove. 

The inventors have shown that the unknown variable ex () 
satisfies the matrix equation 



<*(>=■ 



a 0 r,r 2 ... r L 



20 From the fact thnt this formula expresses a relationship among probabilities, we 
know that the product of r { matrices on the right has largest eigenvalue equal 

to Y f J * that the corresponding eigenvector must be a probability 

vector. 

With the initial p L = (777... /J 7 ", equation (6) gives fi Lmi . Thus, 
25 repeated applications of this backward recursion give all the fi ( . Once a () is 
known and fi L is set, all computations in the circular MAP decoder of the 
present invention follow the conventional MAP decoding algorithm. 
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FIG. 4 is u simplified block diagram illustrating a circular MAP 
decoder 110 for decoding an error-correcting tail-biting trellis code in 
accordance with the eigenvector method described hereinabove. Decoder 1 10 
comprises a r, calculator 1 12 which calculates T, as a function of the channel 
5 output?,. The T, calculator receives a* inputs the following from a memory 
130- the channel transition probability R(Y„ X). the probability - Pl ( m \m') that 
the encoder makes a transition from state m to m at time t. and the probability 
q,(X\m\m) that the encoder* output symbol is X given that the previous 
encoder state is m' and the present encoder state is m. The T, calculator 
10 calculates each element of r, by summing over all possible encoder outputs X 
in accordance with equation (2). 

The calculated values of T, arc provided to a matrix product 
calculator 1 14 to form the matrix product r, T 2 ... T L using an identity matnx 
116 eg received from memory, a switch 118 and a delay circuit 120. At time 
I5 , = ]. the identity matrix is applied as one input to d,e matrix product calculator. 
For each subsequent time from r = 2 to r = L. the matrix product JJ F i 

fed back via the delay circuit to the matrix product calculator. Then, at time t = 
L the resulting matrix product is provided via a switch 121 tu a normalized 
eigenvector computer 122 which calculates die normalized eigenvector 
20 corresponding to the largest eigenvalue of the matrix product input thereto. 

With oe 0 thus initialized, i.e.. as this normalized eigenvector, the succeed.ng a , 
vector* are determined recursively according to equation (5) in a matnx product 
calculator 124 using a delay 126 and switch 128 cin.-uitry.us shown. 
Appropriate values of JT, am retrieved from a memory 1 30. and the resulung a 
25 /are then stored in memory 130. 

The values of P , are determined in a matrix product calculator 
132 using a switch 134 and delay 136 circuitry according to equation (6). Then, 
the probabilities X , are calculated from the values of a , and ft , in an element- 
by-element product calculator 140 according to equation (7). The values o. A , 
30 areprovided to a decoded bit value probability calculator ISO which , deterrntnes 
the probability that the j* decoded bit at rime t, d\ . equals zero. Th.s 

probability 



SUBSTITUTE SHEET (RULE 26) 



WO 97/40582 



PCT/US97/06129 



- 15- 

is provided to a threshold decision device 152 which implements the following 
decision rule: If the probability from calculator 150 is greater than ^ , then 

decide that the decoded hit is zero; if the probability is less than | . then decide 

that the decoded hit is one; if it equals ^ , then the decoded bit is randomly 

5 assigned the value 0 or 1 . The output of die threshold decision device is the 
decoder's output bit at time L 

The probability that the decoded bit equals zero Pfdf = 0 I Yf J 
is also shown in FIG. 4 as being provided to a soft output function block 154 
for providing a function of the probability, i.e., f(Pfdf = 0 I Yf }). such as, for 
10 example, the 

1 - Pfdf = 0 I Yf } 

likelihood ratio = : : 

P/ J/ = 0 I Y f J } 

as the decoder's soft-decision output. Another useful function ot Pftij = I) I 
y/yisthe 

f J-P(j/=( )l Yj ) » 

log likelihood ratio = log f : : J . 

Pfdf = 0 I Yf J 

15 Alternatively, a useful function for block 154 may simply be the identity 
function so that the soft output is just Pfdf = 0 I Yf }. 

An alternative embodiment of the circular MAP decoder 
determines the state probability distributions by a recursion method. In 
particular, in one embodiment (the dynamic convergence method), die 
20 recursion continues until decoder convergence is detected . In this recursion (or 
dynamic convergence) method, steps (ii) and (iii) of the eigen vector method 
described hereinabove are replaced as follows: 
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(iLa) Starling with an initial a (} equal to ( 1/M //MJ. where M is the number 

of states in the trellis, calculate the forward recursion L times. Normalize the 
results so that the elements of each new a, sum to unity. Retain all L a, 

vectors. 

(ii.b) Let Coequal a L from the previous step and, starting at / = 7, calculate the 
first L w cc t probability vectors again. 



M-l 

That is, calculate a t (m) = W y x (i.m) form = ft 1 Af-7 and t = 

i 7 / where L is a suitable minimum number of trellis stages. 

l ** - rt w m i« 



v min 



Normalize as before. Retain only the most recent set of L a s round by die 
10 recursion in steps (ii.u) and Cii.b) and the a, found previously ,n step 

(ii.a). 

(ii.c) Compare a L from step (ii.b) to the previously found set from step 
(ii.a). If the M corresponding elements of the new and old are within a 

tolerance range, proceed to step (iv) set forth hereinabove. Otherwise, continue 
15 to step (ii.d). 

(ii.d) Let t = t + I and calculate a, = a^r r Normalize a_s before. Retain only 
the most recent set of L tfs calculated and the a, found previously in step (iLa). 

(ii e) Compare the new a,* to the previously found set. If the M new and old 
a,'s are within a tolerance range, proceed to step (iv). Otherwise, continue with 
20 step (ii.d) if the two most recen t vectors do not agree to widiin the tolerance 
range and if the number of recursions does not exceed a specified maximum 
(typically 2L): proceeding lo.step (iv) otherwise. 

This method then continues with sieps (iv) and (v) given 
hereinabove with respect to the eigenvector method to produce the soft-decision 
25 outputs and decoded output bits of the circular MAP decoder. 

In another alternative embodiment of the circular MAP decoder 
; described in U.S. Patent Application No. (RD-24,923). the recursion method 



as 
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dcscribcd hereinabove is modified so thai the decoder only needs to process a 
predetermined, fixed number of trellis stages for a second time, that is, a 
predetermined wrap depth. This is advantageous for implementation purposes 
because the number of computations required for decoding is the same for 
5 every encoded message block. Consequently, hardware and software 
complexities are reduced. 

One way to estimate the required wrap depth for MAP decoding 
of a tail-biting convolurional code is to determine it from hardware or software 
experimentation, requiring that a circular MAP decoder with a variable wrap 
0 depth be implemented and experiments be conducted to measure the decoded 
bit error rate versus E^/Nq for successively increasing wrap depths. The 

minimum decoder wrap depth that provides the minimum probability of 
decoded bit error for a specified E t /N 0 is found when further increases in wrap 
depth do noi decrease the error probability. 

If a decoded bit error rate that is greater than the minimum 
achievable at a specified E^/N Q is tolerable, it is possible to reduce the required 

number of trellis stages processed by the circular MAP decoder. In particular, 
the wrap depth search described hereinabove may simply be terminated when 
the desired average probability of bit error is obtained. 

Another way to determine the wrap depth for a given code is by 
using the code's distance properties. To this end, it is necessary to define two 
distinct decoder decision depths. As used herein, the term "correct path" refers 
to the sequence of states or a path through the trellis that results from encoding 
a block of data bits. The term "incorrect subset of a node" ref er s to the set of all 
incorrect (trellis) branches out of a correct path node and their descendents. 
Both the decision depths defined below depend on the convolunonal encoder. 

The decision depths are defined as follows: 

(i) Define the forward decision depth for e -error correction. LF(e) , to be the 
first depth in ihe trellis at which all paths in the incorrect subset of a correct path 
initial node, whether later merging to the correct path or not, lie more than a 
Hamming distance 2e from the correct path. The significance of LF(e) is that 
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if there are e or fewer errors forward of the initial node, and encoding is known 
to have begun there, then the decoder must decode correctly. A formal 
tabulation of forward decision depths for convolutiona] codes was provided by 
J.B. Anderson and K. BaJachandran in "Decision Depths of Convolutiona! 
5 Codes", IEEE Transactions on Information Theory, vol. IT- 35, pp. 455-59, 
March 1989. A number of properties of LF(e) ate disclosed in this reference 
and also by J.B. Anderson and S. Mohan in Source and Channel Coding - An 
Algorithmic Approach, Kluwer Academic Publishers. Norwell, MA, 1991. 
Chief among these properties is that a simple linear relation exists between LF 
10 and e; for example, with rate 7/2 codes, -LF is approximately 9.08e . 

(ii) Next define the uronerged decision depth for *-error correction, LU(e) , to 
be the first depth in the trellis at which all paths in the trellis that never touch the 
correct path lie more than a Hamming distance of 2e away from the correct 
path. 

1 5 The significance of LU(e) for soft-decision circular MAP 

decoding is that the probability of identifying a state on the actual transmitted 
path is high after the decoder processes LU(e) trellis stages. Therefore, the 
minimum wrap depth for circular MAP decoding is LU(e). Calculations of the 
depth LU{e) show that it is always larger than LF(t) but that it obeys the same 

2 0 approximate law. This implies that the minimum wrap depth can be estimated 
as the forward decision depth LF(e) if the unmcrged decision depth of a code is 
not known. 

By finding the minimum unmcrged decision depth for a given 
encoder, we find the fewest number of trellis stages that must be processed by a 
2 5 practical circular decoder that generates soft-decision outputs. An algorithm to 
find LF(e) % the forward decision depth, was given by JiJ. Anderson and K. 
Balachandran in "Decision Depths of Convolutional Codes", cited hereinabove. 
To find Lt/feJ: 



30 



(i) Extend the code trellis from left to right, starting from all 
trellis nodes simultaneously, except for the zero-state. 
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(ii) At each level, delete any paths that merge it) the correct (all- 
zero) path; do not extend any paths out of the correct (zero) state node. 

(Hi) At level k. find the least Hamming distance, or weight, 
among paths terminating at nodes at this level. 

5 <iv) If this least distance exceeds 2e* stop. Then, LU(c) = k. 

As described in U.S. Patent Application No. (RD-24/J23), 
experimentation via computer simulation lead to two unexpected results: (1) 
wrapped processing of p { improves decoder performance; and (2) the use of a 

wrap depth of LJJ{e) + LF(e) - 2 LF( e) improves performance significantly. 
10 Hence, a preferred embodiment of the circular MAP decoder algorithm hxsed 
on recursion comprises the following steps: 

(i) Calculate T f for ; = /. 2. ... L according to equation (2). 

(ii) Starting with an initial a () equal to f7/M..... ///VfJ, where M is 

the number of slates in the trellis, calculate the forward recursion of equation (5) 
15 (L + LJ times for u = 7, 2, ... (L 4 I J where L w is the decoders wrap depth. 

The trellis-level index t takes on the values ((u-J) mad L) + 1. When the 
decoder wraps around the received sequence of symbols from the channel, cc L 
is treated as a^y Normalize the results so that the elements of each new a, sum 
to unity. Retain the L most recent (X vectors found via this recursion. 

20 (iii) Starling with an initial fi L equal to (J /J 7 , calculate the 

backward recursion of equation (6) (L + L w ) times for w = 7. 2. ... (L + L }V ). 

The trellis-level index t takes on the values L-(u mod L). When the decoder 
wraps around the received sequence, fi/is used as P L+] and F; is used as 
J~L + 7 when calculating the new P L . Normalize the results so that the elements 
25 of each new fj { sum to unity. Again, retain the L most recent £ vectors found 

via this recursion. 

The next step of this preferred recursion method is the same as 
step (v) set forth hereinabove with respect to the eigenvector method to produce 
the soft-decisions and decoded bits output by the circular MAP decoder. 
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FIG. 5 is a simplified block diagram illustrating a circular MAP 
decoder 180 in accordance with this preferred embodiment of the present 
invention. Decoder 180 comprises a T, calculator 182 which calculates T, as a 
function of the channel output y,. The channel outputs y $ y L are provided to 

5 the J) calculator via a switch 184. With the switch in the down position, L 
channel output symbols are loaded into a T f calculator 182 and a shift register 
186 one at a time. Then, switch 184 is moved to the up position to allow the 
shift register to shift the first L w received symbols into the F, calculator again, 
he., to provide circular processing. The r t calculator receives as inputs from 

10 memory 130 the channel transition probability R(Y h X), the probability 

p t (m\m') that the encoder makes a transition from state m to m at time u and 
the probability q t (X\m\ m) that the encoder's output symbol is X given that the 
previous encoder state is m and the present encoder state is m. The J"} 
calculator calculates each element of T, by summing over all possible encoder 

15 outputs X in accordance with equation (2). 

The calculated values of J) are provided to a matrix punluct 
calculator 190 which multiplies the T, matrix by the a , .1 matrix, which is 
provided recursively via a delay 192 and demultiplexer 194 circuit. Control 
signal CNTRL1 causes demultiplexer 194 to select a 0 from memory 196 as 

20 one input to matrix product calculator 190 when t = 1. When 2 5 t 5 L, control 
signal CNTRL1 causes demultiplexer 194 to select a from delay 192 as 

one input to matrix product calculator 1 90. Values of T and a , are stored in 
memory 1 96 us required. 

The 1 vectors ant calculated recursively in a matrix product 
25 calculator 2(H) via a delay 202 and demultiplexer 204 circuit. Control signal 
CNTRL2 causes demultiplexer 204 to select p L from memory 196 as one 

input to matrix product calculator 200 when t = L-L When L-2 > t > 7, control 
signal CNTRJL2 causes demultiplexer 2(>4 to select P r+I from delay 102 as 

one input to matrix product calculator 2(M). The resulting values of P / arc 
30 multiplied by the values of a t , obtained from memory 196, in an elemem-by- 
element product calculator 206 to provide the probabilities A , . as described 
hereinabove. In the same manner as described hereinabove with reference to 
PIG. 4, the values of A, are provided to a decoded bit value probability 
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calculator 150, the output of which is provided to a threshold decision device 
152, resulting in the decoder's decoded output bits. 

The conditional probability that the decoded bit equals zero 
(Pfdj = 0 I 'Y* 7) is also shown in FIG. 5 as heing provided to a soft output 
5 function block 154 for providing a function of the probability. 
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i.e.. HP(dj = 0 I Y j t }). such as. for example, the 

J - Pfdj = 0 1 Y f J J 
likelihood ratio = . / 

Pf<l/=()\ Yj J 

as the decoder's soft-decision output. Another useful function oi 

P(df = 0 I Yj J is the 

f J.P(d l j =0\ Yj I j 
5 log likelihood ratio = I og f ^ =(>iy j ; > 

Alternatively, a useful function for block 1 34 may simply he the identity 
function so that the soft output is just Pfdf = 0 I Yf J . 

In accordance with the present invention, it is possible to 
increase the rate of the parallel concatenated coding scheme comprising tail- 

10 biung nonrecursive systematic codes by deleting selected bits in the composite 
codeword formed by the composite codeword formatter according to an 
advantageously chosen pattern prior to transmitting the bits of the composite 
codeword over a channel. This technique is known as puncturing. This 
puncturing pattern is also known by the decoder. The following simple 

15 additional step performed by the received composite-codeword-to-component- 
codeword converter provides the desired decoder operation: the received 
composite-codeword-to-comppnent-codeword converter merely inserts a 
neutral value for each known punctured bit during the formation of the received 
component codewords. For example, the neutral value is for the case of 

20 antipodal signalling over an additive white Gaussian noise channel. The rest ol 
the decoder's operation is as described hereinabove. 

It has heretofore been widely accepted that nonrecursive 
systematic convolutional codes would not be useful as the component codes in 
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a parallel concatenated coding scheme because of the superior distance 
properties of RSC codes for relatively large the data block lengths, as reported, 
for example in S. Benedetto and G. Montorsi. "Design of Parallel Concatenated 
Convoiutional Codes," IEEE Transactions on Communications, to be 
published. However, as described hereinabove, the inventors have determined 
that the minimum distance of a NSC code is less sensitive to data block length 
and, therefore, can be used advantageously in communication systems that 
transmit short blocks of data bits in very noisy channels. In addition, the 
inventon have determined that the use of tail-biting codes solves the problem of 
termination of input data sequences in rurbo codes. Use of tail-biting 
convoiutional codes as component codes in a parallel concatenated codin g 
scheme has not been proposed heretofore. Hence, the present invention 
provides a parallel concatenated nonrecursive tail-biting systematic 
convoiutional coding scheme with a decoder comprising circular MAP 
decoders for decoding the component tail-biting convoiutional codes to provide 
better performance for short data block lengths than in conventional turbo 
coding schemes, as measured in terms of bit error rate versus signal-to-noise 
ratio. 

While the preferred embodiments of the present invention have 
been shown and described herein, it will be obvious that such embodiments are 
provided by way of example only. Numerous variations, changes and 
substitutions will occur to those of skill in the an without departing from the 
invention herein. Accordingly, it is intended that the invention be limited only 
by the spirit and scope of the appended claims. 
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PARALLEL CONCATENATED TAIL-BITING 
CONVOLUTION AL CODE AND DECODER THEREFOR 

WHAT IS CLAIMED IS: 

1. A method for parallel concatenated convolutional encoding, 
comprising the steps of: 

providing a block of data bits to a parallel concatenated encoder 
comprising a plurality of N component encoders and N-l interleavers 
connected in a parallel concatenation; 

encoding the block of data bits in a First one of the component 
encoders by applying a tail-biting nonrecursive systematic convolutional code 
thereto and thereby generating a corresponding first component codeword 
comprising the data bits and parity bits; 

interleaving the block of data bits to provide a permuted block of 

data bits; 

encoding the resulting permuted block of data bits in a 
subsequent component encoder by applying a tail-biting nonrecursive 
systematic convolutional code thereto, and thereby generating a corresponding 
second component codeword comprising the data bits and parity bits; 

repeating the steps of interleaving and encoding the resulting 
permuted block of data bits through the remaining N-2 interleavers and the 
remaining N-2 component encoders, and thereby generating component 
codewords comprising the data bits and parity bits; and 

formatting the bits of the component codewords to provide a 
composite codeword. . 

2. The method of claim I wherein the formatting step is 
performed such that the composite codeword includes only one occurrence of 
each bit in the block of data bits. 
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3. The method of claim 1 wherein the formatting step is 
performed such that the composite codeword includes only selected ones of the 
bits comprising the component codewords according to a predetermined 
pattern. 

4. A method for decoding parallel concatenated convolutionaJ 
codes, comprising the steps of: 

receiving from a channel a composite codeword that comprises 
a formatted collection of bits from a plurality (N) of component codewords that 
have been generated by applying tail-biting noniecursive systematic 
conventional codes to a block of data bits in a parallel concatenated encoder, 
forming received component codewords from the received composite 
codeword, each respective received component codeword being received by a 
corresponding one of a plurality of N component decoders of a composite ' 
decoder, each respective component decoder also receiving a set of a priori 
soft-decision information for values of the data bits; 

decoding the received component codewords by a process of 
iterations through the N component decoders and N-l interleavers to provide 
soft-decision outputs from the composite decoder, the N component decoders 
each providing soft-decision information on each data bit in the data block in the 
order encoded by the corresponding component encoder, the N-l interleavers 
each interleaving the soft-decision information from a preceding component 
decoder to provide a permuted block of soft information to a subsequent 
component decoder, the set of apriori soft-decision information for the first of 
the N component decoders being calculated assuming that the data bits* values 
are equally likely for the first iteration and thereafter comprising a first function 
of the soft-decision information, which first function of the soft-decision 
information is fed back from the N lh component decoder via a first 
deinterleaver comprising N- 1 deinterleavers corresponding to the N- 1 
interleavers, the N-l deinterleavers of the first deinterleaver being applied in 
reverse order to the N- 1 interleavers, the set of a priori soft-decision 
information provided to each other component decoder comprising the first 
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function of the soft-decision information from the previous sequential 
component decoder; and 

deinterleaving in a second deinterleaver to provide a second 
function of the soft-decision output from the N th component decoder as the 
composite decoder's soft-decision output using N-I deinterleavers 
corresponding to the N-l interleaves, the N-l deinterleavers of the second 
deinterleaver being applied in reverse order to the N-l interleaves. 

5. The method of claim 4 wherein the number of iterations 
through the component decoders, interleaves and deinterleavers is a 
predetermined number. 

6. The method of claim 4 wherein the iterations through the 
component decoders, interleaves and deinterleaves continues until decoder 
convergence is detected if the number of iterations is less than a maximum 
number; otherwise decoding terminates after the maximum number of 
iterations, and the composite decoder provides the second function of soft- 
decision outputs from the component decoder as its soft-decision output via 
the second deinterleaver. 

7. The method of claim4, further comprising the step of 
implementing a decision rule to provide hard-decision outputs as a function of 
the composite decoder's soft-decision output. 

8. The method of claim 4 wherein the formatted collection of 
bits has been punctured according to a predetermined pattern, the method for 
decoding further comprising the step of inserting neutral values for all 
punctured bits when forming the received component codewords. 

9. The method of clai*m4 wherein the decoding step is 
performed by the N component decoders comprising circular MAP decodes, 
the decoding step comprising solving an eigenvector problem. 

10. The method of claim 4 wherein the decoding step is 
performed by the N component decoders comprising circular MAP decoders, 
the decoding step comprising a recursion method. 
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1 1. A method for encoding and decoding parallel concatenated 
convolutional codes, comprising the steps of: 

providing a block of data bits to a parallel concatenated encoder 
comprising a plurality of N component encoders and N-l interleaves 
5 connected in a parallel concatenation; 

encoding the block of data bits in a first one of the component 
encoders by applying a tail-biting nonrecursive systematic convolutional code 
thereto and thereby generating a corresponding first component codeword 
comprising the data bits and parity bits; 

10 interleaving the block of data bits to provide a permuted block of 

data bits; 

encoding the resulting permuted block of data bits in a 
subsequent component encoder by applying a tail-biting nonrecursi ve 
systematic convolutional code thereto and thereby generating a corresponding 
15 second component codeword comprising the data bits and parity bits; 

repeating the steps of interleaving and encoding the resulting 
permuted block of data bits through the remaining N-2 interleaves and the 
remaining N-2 component encoders, and thereby generating component 
codewords comprising the data bits and parity bits; 

2 0 formatting the bits of the component codewords to provide a 

composite codeword; 

inputting the composite codeword to a channel; 

receiving a received composite codeword from a channel; 

forming received component codewords from the received 
25 composite codeword 

providing each respective received component codeword to a 
corresponding one of a plurality of N component decoders of a composite 
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decoder, each respective component decoder also receiving a set of a priori 
probabilities for values of the data bits; 

decoding the received component codewords by a process of 
iterations through the N component decoders and N-l interleavers to provide 
soft-decision outputs from the composite decoder, the N component decoders 
each providing soft-decision information on each data bit in the data block in the 
order encoded by the corresponding component encoder, the N- 1 interleavers 
each interleaving the soft-decision information from a preceding component 
decoder to provide a permuted block of soft information to a subsequent 
component decoder, the set of a priori soft-decision information for the first of 
the N component decoders being calculated assuming that the data bits' values 
are equally likely for the first iteration and thereafter comprising a first function 
of the soft-decision information, which first function of the soft-decision 
information is fed back from the decoder via a first deinterleaver 
comprising N-l deinterleavers corresponding to the N-l interleavers, the N-l 
deinterleavers of the first deinterleaver being applied in reverse order to the N- 1 
interleavers, the set of a priori soft-decision information provided to each other 
component decoder comprising the first function of the soft-decision 
information from the previous sequential component decoder and 

dcinterleaving in a second deinterleaver to provide a second 
function of the soft-decision output from the N*h component decoder as the 
composite decoder's soft-decision output using N-l deinterleavers 
corresponding to the N-l interleavers, the N-l deinterleavers of the second 
deinterleaver being applied in reverse order to the N- 1 interleavers. 

12. The method of claim 1 1 wherein the formatting step is 
performed such that the composite codeword includes only one occurrence of 
each bit in the block of data bits. 

13. The method of claim 1 I wherein the formatting step is 
performed such that the composite codeword includes only selected ones of the 
bits comprising the component codewords according to a predetermined 
pattern. 
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14. The method of claim 1 1 wherein the number of iterations 
through the component decoders, interleavers and deinterleavers is a 
predetermined number. 

1 5. The method of claim 1 1 wherein the iterations through the 
component decoders, N-l interleavers and deinterleavers continues until 
decoder convergence is detected if the number of iterations is less than a 
maximum number; otherwise decoding terminates after the maximum number 

5 of iterations, and the composite decoder provides the second function of soft- 
decision outputs from the N 1 * 1 component decoder as its soft-decision output via 
the second deinterleaver. 

16. The method of claim 1 K further comprising the step of 
implementing a decision rule to provide hard-decision outputs as a function of 
the composite decoder's soft-decision output. 

17. The method of claim 1 1 wherein the decoding step is 
performed by the N component decoders comprising circular MAP decoders, 
the decoding step comprising solving an eigenvector problem. 

18. The method of claim 1 1 wherein the decoding step is 
performed by the N component decoders comprising circular MAP decoders, 
the decoding step comprising a recursion method. 

19. The method of claim I 1 wherein the formatting step further 
comprises puncturing selected ones of the bits from the component codewords 
which comprise the composite codeword according to a predetermined pattern, 
the method for decoding further comprising the step of inserting neutral values 

5 for all punctured bits when forming the received component codewords. 

20. A parallel concatenated encoder, comprising: 

a plurality (N) of component encoders and a plurality (N-l) of 
interleavers connected in a parallel concatenation for systematically applying 
tail-biting nonrecursive systematic convolutional codes to a block of data bits 
5 and various permutations of the block of data bits, and thereby generating 
component codewords comprising the data bits and parity bits ; and 
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a composite codeword formatter for formatting the collection of 
bits from the component codewords to provide a composite codeword. 

2 1 . The encoder of claim 20 wherein the composite codeword 
formatter produces the composite codeword such that it includes only one 
occurrence of each bit in the block of data bits. 

22. The encoder of claim 20 wherein the composite codeword 
produces the composite codeword such that it includes only selected ones of the 
bits comprising the component codewords according to a predetermined 
pattern. 

23. A composite decoder for decoding parallel concatenated 
convolutional codes, comprising: 

a composite-codeword-to-component-codeword converter for 
receiving a composite codeword from a channel, the composite codeword 
comprising selected bits of a plurality of N component codewords that have 
been generated by applying tail-biting nonrecursive convolutional codes to a 
block of data bits in a parallel concatenated encoder, and forming a plurality of 
N corresponding received component codewords therefrom; 

a plurality (N) of component decoders, each respective decoder 
receiving a corresponding received component codeword from the cornposiie- 
codeword-to-component- codeword converter, each respective decoder also 
receiving a set of a priori soft-decision information for values of the data bits, 
the N component decoders each providing soft-decision information on each 
data bit in the data block in the order encoded by a corresponding component 
encoder in the parallel concatenated encoder; 

a plurality of N-l interleaves, each respective interleaver 
interleaving the soft-decision information from a corresponding component 
decoder to provide a permuted block of soft information to a subsequent 
component decoder, the received codewords being decoded by a process of 
iterations through the N component decoders and N-l interleavers to provide 
soft-decision output from the composite decoder; 
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a first deinterleaver comprising N-l deinterleavers 
corresponding to the N-l interleavers, the N-l deinterleavers of the first 
deinterleaver being applied in reverse order to the N-l interleaves, the set of a 

25 priori soft-decision information for the first of the N component decoders 

being calculated assuming that the data bits' values are equally likely for the first 
iteration and thereafter comprising a first function of the soft-decision 
information, which first function of the soft-decision information is outputted 
by the decoder and fed back via the first deinterleaver, the set of a priori 

3 0 soft-decision information provided to each other component decoder 

comprising the first function of the soft-decision information from the previous 
sequential component decoder; and 

a second deinterleaver comprising N- ! deinterleavers 
corresponding to the N- 1 interleavers, the N- 1 deinterleavers of the second 
3 5 deinterleaver being applied in reverse order to the N- 1 interleavers, the second 
deinterleaver deinterleaving a second function of the soft-decision output from 
the N 11 * component decoder to provide the composite decoder's soft-decision 
output. 

24. The decoder of claim 23 wherein the number of iterations 
through the component decoders, interleavers and deinterleavers is a 
predetermined number. 

25. The decoder of claim 23 wherein the iterations through the 
component decoders, interleavers and deinterleavers continues until decoder 
convergence is detected if the number of iterations is less than a maximum 
number; otherwise decoding terminates after the maximum number of 

5 iterations, and the composite decoder provides the second function of soft- 
decision outputs from the component decoder as its soft-decision output via 
the second deinterleaver. 

26. The decoder of claim 23, further comprising a decision 
device for implementing a decision rule to provide hard-decision outputs as a 
function of the composite decoder's soft-decision output. 



-32- 



27. The method of claim 23 wherein the N component decoders 
comprise circular MAP decoders which decode by solving an eigenvector 
problem. 

28. The method of claim 23 wherein the N component decoders 
comprise circular MAP decoders which decode by using a recursion method. 

29. An encoder and decoder system for encoding and decoding 
parallel concatenated convolution^ codes, comprising: 

a parallel concatenated encoder comprising a plurality (N) of 
component encoders and a plurality (N- 1 ) of encoder interleaves connected in a 
parallel concatenation for systematically applying tail-biting nonrecursive 
systematic convolutional codes to a block of data bits and various permutations 
of the block of data bits, and thereby generating component codewords 
comprising the data bits and parity bits; and 

a composite codeword formatter for formatting the collection of 
bits from the component codewords to provide a composite codeword; 

a composite-codeword-to-component-codeword converter for 
receiving the composite codeword from a channel and forming a plurality of N 
corresponding received component codewords therefrom; 

a plurality (N) of component decoders, each xespecti ve decoder 
receiving a corresponding received component codeword from the composite- 
codeword-to-component-codeword converter, each respective decoder also 
receiving a set of a priori soft-decision information for values of the data bits, 
the N component decoders each providing soft-decision information on each 
data bit in the data block in the order encoded by a corresponding component 
encoder in the parallel concatenated encoder; 

a plurality of N- 1 interleaves, each respective interleaver 
interleaving the soft-decision information from a corresponding component 
decoder to provide a permuted block of soft information to a subsequent 
component decoder, the received codewords being decoded by a process of 
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iterations through the N component decoders and N-l interleavers to provide 
soft-decision output from the composite decoder, 

a first deinterleaver comprising N-l deinterleavers 
corresponding to the N-l interleavers, the N-l deinterleavers of the first 
deinterleaver being applied in reverse order to the N-l interleavers, the set of a 
priori soft-decision information for the first of the N component decoders 
being calculated assuming that the data bits' values are equally likely for the first 
iteration and thereafter comprising a first function of the soft-decision 
information, which first function of the soft-decision information is outputted 
by the N 1 * 1 decoder and fed back via the first deinterleaver, the set of a priori 
soft-decision information provided to each other component decoder 
comprising the first function of the soft-decision information from the previous 
sequential component decoder; and 

a second deinterleaver comprising N- 1 deinterleavers 
corresponding to the N-l interleavers, the N-I deinterleavers of the second 
deinterleaver being applied in reverse order to the N- 1 interleavers, the second 
deinterleaver dei interleaving a second function of the soft-decision output from 
the N 1 * 1 component decoder to provide the composite decoder's soft-decision 
output. 

30. The encoder and decoder system of claim 29 wherein the 
composite codeword formatter produces the composite codeword such that it 
includes only one occurrence of each bit in the block of data bits. 

3 1 . The encoder and decoder system of claim 29 wherein the 
composite codeword produces the composite codeword such that it includes 
only selected ones of the bits comprising the component codewords according 
to a predetermined pattern. 

32. The encoder and decoder system of claim 29 wherein the 
number of iterations through the component decoders, interleavers and 
deinterleavers is a predetermined number. 

33 . The encoder and decoder system of claim 29 wherein the 
iterations through the component decoders, interleavers and deinterleavers 
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continues until decoder convergence is detected if the number of iterations is 
less than a maximum number; otherwise decoding terminates after the 
5 maximum number of iterations, and the composite decoder provides the second 
function of soft-decision outputs from the N 1 * 1 component decoder as its soft- 
decision output via the second deinterleaver. 

34. The encoder and decoder system of claim 29, further 
comprising a decision device for implementing a decision rule to provide hard- 
decision outputs as a function of the decoder's soft-decision output. 

35. The method of claim 29 wherein the N component decoders 
comprise circular MAP decoders which decode by solving an eigenvector 
problem. 

36. The method of claim 29 wherein the N component decoders 
comprise circular MAP decoders which decode by using a recursion method. . 
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